Pandas Profiling Report

Dataset statistics

Number of variables	16
Number of observations	2775
Missing cells	0
Missing cells (%)	0.0%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	347.0 KiB
Average record size in memory	128.0 B

Variable types

Numeric	16

Alerts

`gross_revenue` is highly correlated with `qnt_purchases` and 3 other fields	High correlation
`qnt_purchases` is highly correlated with `gross_revenue` and 2 other fields	High correlation
`var_products` is highly correlated with `gross_revenue` and 3 other fields	High correlation
`qnt_items` is highly correlated with `gross_revenue` and 3 other fields	High correlation
`avg_ticket` is highly correlated with `avg_basket_variety`	High correlation
`avg_recency_days` is highly correlated with `freq_purchase`	High correlation
`freq_purchase` is highly correlated with `avg_recency_days`	High correlation
`qtd_returned` is highly correlated with `freq_returns` and 2 other fields	High correlation
`freq_returns` is highly correlated with `qtd_returned` and 2 other fields	High correlation
`avg_basket_size` is highly correlated with `gross_revenue` and 1 other fields	High correlation
`avg_basket_variety` is highly correlated with `var_products` and 1 other fields	High correlation
`item_rp_ratio` is highly correlated with `qtd_returned` and 2 other fields	High correlation
`net_margin` is highly correlated with `qtd_returned` and 2 other fields	High correlation
`gross_revenue` is highly correlated with `qnt_purchases` and 1 other fields	High correlation
`qnt_purchases` is highly correlated with `gross_revenue` and 2 other fields	High correlation
`var_products` is highly correlated with `qnt_purchases`	High correlation
`qnt_items` is highly correlated with `gross_revenue` and 2 other fields	High correlation
`avg_basket_size` is highly correlated with `qnt_items`	High correlation
`item_rp_ratio` is highly correlated with `net_margin`	High correlation
`net_margin` is highly correlated with `item_rp_ratio`	High correlation
`gross_revenue` is highly correlated with `qnt_purchases` and 1 other fields	High correlation
`qnt_purchases` is highly correlated with `gross_revenue` and 1 other fields	High correlation
`var_products` is highly correlated with `avg_basket_variety`	High correlation
`qnt_items` is highly correlated with `gross_revenue` and 2 other fields	High correlation
`avg_recency_days` is highly correlated with `freq_purchase`	High correlation
`freq_purchase` is highly correlated with `avg_recency_days`	High correlation
`qtd_returned` is highly correlated with `freq_returns` and 2 other fields	High correlation
`freq_returns` is highly correlated with `qtd_returned` and 2 other fields	High correlation
`avg_basket_size` is highly correlated with `qnt_items`	High correlation
`avg_basket_variety` is highly correlated with `var_products`	High correlation
`item_rp_ratio` is highly correlated with `qtd_returned` and 2 other fields	High correlation
`net_margin` is highly correlated with `qtd_returned` and 2 other fields	High correlation
`df_index` is highly correlated with `avg_recency_days`	High correlation
`gross_revenue` is highly correlated with `qnt_purchases` and 4 other fields	High correlation
`qnt_purchases` is highly correlated with `gross_revenue` and 4 other fields	High correlation
`var_products` is highly correlated with `gross_revenue` and 3 other fields	High correlation
`qnt_items` is highly correlated with `gross_revenue` and 4 other fields	High correlation
`avg_ticket` is highly correlated with `qtd_returned`	High correlation
`avg_recency_days` is highly correlated with `df_index`	High correlation
`qtd_returned` is highly correlated with `gross_revenue` and 4 other fields	High correlation
`avg_basket_size` is highly correlated with `gross_revenue` and 2 other fields	High correlation
`item_rp_ratio` is highly correlated with `net_margin`	High correlation
`net_margin` is highly correlated with `item_rp_ratio`	High correlation
`freq_purchase` is highly skewed (γ1 = 46.09420632)	Skewed
`df_index` has unique values	Unique
`customer_id` has unique values	Unique
`recency_days` has 33 (1.2%) zeros	Zeros
`qtd_returned` has 1484 (53.5%) zeros	Zeros
`freq_returns` has 1484 (53.5%) zeros	Zeros
`item_rp_ratio` has 1484 (53.5%) zeros	Zeros

Reproduction

Analysis started	2021-10-23 02:41:17.011759
Analysis finished	2021-10-23 02:41:41.941819
Duration	24.93 seconds
Software version	pandas-profiling v3.1.0
Download configuration	config.json

df_index
Real number (ℝ_≥0)

HIGH CORRELATION
UNIQUE

Distinct	2775
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	2251.409369

Minimum	0
Maximum	5698
Zeros	1
Zeros (%)	< 0.1%
Negative	0
Negative (%)	0.0%
Memory size	21.8 KiB

Quantile statistics

Minimum	0
5-th percentile	179.7
Q1	901
median	2060
Q3	3412
95-th percentile	4961.3
Maximum	5698
Range	5698
Interquartile range (IQR)	2511

Descriptive statistics

Standard deviation	1527.723888
Coefficient of variation (CV)	0.678563352
Kurtosis	-0.9562554739
Mean	2251.409369
Median Absolute Deviation (MAD)	1241
Skewness	0.3794131209
Sum	6247661
Variance	2333940.279
Monotonicity	Strictly increasing

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	1	< 0.1%
2912	1	< 0.1%
2897	1	< 0.1%
2898	1	< 0.1%
2902	1	< 0.1%
2903	1	< 0.1%
2904	1	< 0.1%
2905	1	< 0.1%
2907	1	< 0.1%
2908	1	< 0.1%
Other values (2765)	2765	99.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	1	< 0.1%
1	1	< 0.1%
2	1	< 0.1%
3	1	< 0.1%
4	1	< 0.1%
5	1	< 0.1%
6	1	< 0.1%
7	1	< 0.1%
8	1	< 0.1%
9	1	< 0.1%

Value	Count	Frequency (%)
5698	1	< 0.1%
5688	1	< 0.1%
5682	1	< 0.1%
5657	1	< 0.1%
5651	1	< 0.1%
5640	1	< 0.1%
5639	1	< 0.1%
5622	1	< 0.1%
5621	1	< 0.1%
5612	1	< 0.1%

customer_id
Real number (ℝ_≥0)

UNIQUE

Distinct	2775
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	15283.54811

Minimum	12347
Maximum	18287
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	21.8 KiB

Quantile statistics

Minimum	12347
5-th percentile	12625.7
Q1	13814.5
median	15239
Q3	16779.5
95-th percentile	17950.3
Maximum	18287
Range	5940
Interquartile range (IQR)	2965

Descriptive statistics

Standard deviation	1715.466409
Coefficient of variation (CV)	0.1122426806
Kurtosis	-1.206544394
Mean	15283.54811
Median Absolute Deviation (MAD)	1484
Skewness	0.01769381525
Sum	42411846
Variance	2942825.001
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
17850	1	< 0.1%
13811	1	< 0.1%
16933	1	< 0.1%
13772	1	< 0.1%
16249	1	< 0.1%
14198	1	< 0.1%
13989	1	< 0.1%
17930	1	< 0.1%
14482	1	< 0.1%
14163	1	< 0.1%
Other values (2765)	2765	99.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
12347	1	< 0.1%
12348	1	< 0.1%
12352	1	< 0.1%
12356	1	< 0.1%
12358	1	< 0.1%
12359	1	< 0.1%
12360	1	< 0.1%
12362	1	< 0.1%
12363	1	< 0.1%
12364	1	< 0.1%

Value	Count	Frequency (%)
18287	1	< 0.1%
18283	1	< 0.1%
18282	1	< 0.1%
18273	1	< 0.1%
18272	1	< 0.1%
18270	1	< 0.1%
18265	1	< 0.1%
18263	1	< 0.1%
18261	1	< 0.1%
18260	1	< 0.1%

gross_revenue
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	2761
Distinct (%)	99.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	2826.841474

Minimum	36.56
Maximum	279138.02
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	21.8 KiB

Quantile statistics

Minimum	36.56
5-th percentile	264.566
Q1	627.06
median	1166.77
Q3	2418.375
95-th percentile	7395.585
Maximum	279138.02
Range	279101.46
Interquartile range (IQR)	1791.315

Descriptive statistics

Standard deviation	10426.6716
Coefficient of variation (CV)	3.688452889
Kurtosis	378.2513316
Mean	2826.841474
Median Absolute Deviation (MAD)	684.76
Skewness	17.25283085
Sum	7844485.09
Variance	108715480.7
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1025.44	2	0.1%
889.93	2	0.1%
331	2	0.1%
2053.02	2	0.1%
379.65	2	0.1%
731.9	2	0.1%
178.96	2	0.1%
1353.74	2	0.1%
745.06	2	0.1%
2092.32	2	0.1%
Other values (2751)	2755	99.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
36.56	1	< 0.1%
52	1	< 0.1%
52.2	1	< 0.1%
62.43	1	< 0.1%
68.84	1	< 0.1%
70.02	1	< 0.1%
77.4	1	< 0.1%
84.65	1	< 0.1%
90.3	1	< 0.1%
93.35	1	< 0.1%

Value	Count	Frequency (%)
279138.02	1	< 0.1%
259657.3	1	< 0.1%
194550.79	1	< 0.1%
140450.72	1	< 0.1%
124564.53	1	< 0.1%
117379.63	1	< 0.1%
91062.38	1	< 0.1%
70100.49	1	< 0.1%
66653.56	1	< 0.1%
65039.62	1	< 0.1%

recency_days
Real number (ℝ_≥0)

ZEROS

Distinct	251
Distinct (%)	9.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	56.60864865

Minimum	0
Maximum	372
Zeros	33
Zeros (%)	1.2%
Negative	0
Negative (%)	0.0%
Memory size	21.8 KiB

Quantile statistics

Minimum	0
5-th percentile	2
Q1	10
median	29
Q3	73
95-th percentile	210.3
Maximum	372
Range	372
Interquartile range (IQR)	63

Descriptive statistics

Standard deviation	68.23959812
Coefficient of variation (CV)	1.205462412
Kurtosis	3.437475511
Mean	56.60864865
Median Absolute Deviation (MAD)	24
Skewness	1.895607805
Sum	157089
Variance	4656.642751
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	99	3.6%
4	87	3.1%
2	85	3.1%
3	85	3.1%
8	76	2.7%
10	67	2.4%
9	66	2.4%
7	65	2.3%
17	62	2.2%
22	55	2.0%
Other values (241)	2028	73.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	33	1.2%
1	99	3.6%
2	85	3.1%
3	85	3.1%
4	87	3.1%
5	43	1.5%
7	65	2.3%
8	76	2.7%
9	66	2.4%
10	67	2.4%

Value	Count	Frequency (%)
372	1	< 0.1%
366	1	< 0.1%
360	1	< 0.1%
358	3	0.1%
354	1	< 0.1%
337	1	< 0.1%
336	2	0.1%
334	1	< 0.1%
333	2	0.1%
330	1	< 0.1%

qnt_purchases
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	55
Distinct (%)	2.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	6.051171171

Minimum	2
Maximum	206
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	21.8 KiB

Quantile statistics

Minimum	2
5-th percentile	2
Q1	2
median	4
Q3	6
95-th percentile	17
Maximum	206
Range	204
Interquartile range (IQR)	4

Descriptive statistics

Standard deviation	9.065784048
Coefficient of variation (CV)	1.49818668
Kurtosis	184.2954466
Mean	6.051171171
Median Absolute Deviation (MAD)	2
Skewness	10.63311281
Sum	16792
Variance	82.18844041
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
2	781	28.1%
3	499	18.0%
4	393	14.2%
5	237	8.5%
6	173	6.2%
7	138	5.0%
8	98	3.5%
9	69	2.5%
10	55	2.0%
11	54	1.9%
Other values (45)	278	10.0%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
2	781	28.1%
3	499	18.0%
4	393	14.2%
5	237	8.5%
6	173	6.2%
7	138	5.0%
8	98	3.5%
9	69	2.5%
10	55	2.0%
11	54	1.9%

Value	Count	Frequency (%)
206	1	< 0.1%
199	1	< 0.1%
124	1	< 0.1%
97	1	< 0.1%
91	2	0.1%
86	1	< 0.1%
72	1	< 0.1%
62	1	< 0.1%
60	2	0.1%
57	1	< 0.1%

var_products
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	340
Distinct (%)	12.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	83.31927928

Minimum	1
Maximum	1786
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	21.8 KiB

Quantile statistics

Minimum	1
5-th percentile	8
Q1	29
median	57
Q3	105
95-th percentile	239.3
Maximum	1786
Range	1785
Interquartile range (IQR)	76

Descriptive statistics

Standard deviation	98.70446504
Coefficient of variation (CV)	1.184653371
Kurtosis	80.67285688
Mean	83.31927928
Median Absolute Deviation (MAD)	33
Skewness	6.354212176
Sum	231211
Variance	9742.57142
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
37	38	1.4%
24	37	1.3%
26	36	1.3%
33	35	1.3%
28	34	1.2%
25	33	1.2%
18	32	1.2%
30	32	1.2%
31	30	1.1%
23	30	1.1%
Other values (330)	2438	87.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	19	0.7%
2	13	0.5%
3	17	0.6%
4	18	0.6%
5	22	0.8%
6	19	0.7%
7	21	0.8%
8	24	0.9%
9	23	0.8%
10	20	0.7%

Value	Count	Frequency (%)
1786	1	< 0.1%
1766	1	< 0.1%
1322	1	< 0.1%
1118	1	< 0.1%
884	1	< 0.1%
817	1	< 0.1%
717	1	< 0.1%
714	1	< 0.1%
699	1	< 0.1%
636	1	< 0.1%

qnt_items
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	1636
Distinct (%)	59.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	1664.05045

Minimum	2
Maximum	196844
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	21.8 KiB

Quantile statistics

Minimum	2
5-th percentile	119.7
Q1	330
median	703
Q3	1478
95-th percentile	4559.4
Maximum	196844
Range	196842
Interquartile range (IQR)	1148

Descriptive statistics

Standard deviation	5877.035531
Coefficient of variation (CV)	3.531765236
Kurtosis	489.6415784
Mean	1664.05045
Median Absolute Deviation (MAD)	451
Skewness	18.27558807
Sum	4617740
Variance	34539546.64
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
310	11	0.4%
246	8	0.3%
150	8	0.3%
1200	7	0.3%
200	7	0.3%
219	7	0.3%
516	7	0.3%
272	7	0.3%
493	7	0.3%
260	7	0.3%
Other values (1626)	2699	97.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
2	1	< 0.1%
16	1	< 0.1%
17	1	< 0.1%
19	1	< 0.1%
20	1	< 0.1%
25	1	< 0.1%
27	2	0.1%
30	1	< 0.1%
32	1	< 0.1%
33	2	0.1%

Value	Count	Frequency (%)
196844	1	< 0.1%
80263	1	< 0.1%
77373	1	< 0.1%
69993	1	< 0.1%
64549	1	< 0.1%
64124	1	< 0.1%
63312	1	< 0.1%
58343	1	< 0.1%
57885	1	< 0.1%
50255	1	< 0.1%

avg_ticket
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION

Distinct	2773
Distinct (%)	99.9%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	30.49399163

Minimum	2.150588235
Maximum	1687.2
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	21.8 KiB

Quantile statistics

Minimum	2.150588235
5-th percentile	4.852950497
Q1	12.43090098
median	17.94081081
Q3	24.99057143
95-th percentile	86.23198132
Maximum	1687.2
Range	1685.049412
Interquartile range (IQR)	12.55967045

Descriptive statistics

Standard deviation	67.28411421
Coefficient of variation (CV)	2.206471197
Kurtosis	182.5219677
Mean	30.49399163
Median Absolute Deviation (MAD)	6.297941958
Skewness	10.92852137
Sum	84620.82676
Variance	4527.152025
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
4.162	2	0.1%
14.47833333	2	0.1%
18.15222222	1	< 0.1%
44.62769231	1	< 0.1%
19.03048387	1	< 0.1%
28.55451613	1	< 0.1%
12.80068182	1	< 0.1%
6.396214689	1	< 0.1%
26.08797101	1	< 0.1%
17.98461538	1	< 0.1%
Other values (2763)	2763	99.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
2.150588235	1	< 0.1%
2.4325	1	< 0.1%
2.462371134	1	< 0.1%
2.511241379	1	< 0.1%
2.515333333	1	< 0.1%
2.65	1	< 0.1%
2.656931818	1	< 0.1%
2.707598253	1	< 0.1%
2.760621572	1	< 0.1%
2.770464191	1	< 0.1%

Value	Count	Frequency (%)
1687.2	1	< 0.1%
952.9875	1	< 0.1%
872.13	1	< 0.1%
841.0214493	1	< 0.1%
651.1683333	1	< 0.1%
640	1	< 0.1%
624.4	1	< 0.1%
615.75	1	< 0.1%
602.4531323	1	< 0.1%
591.7066667	1	< 0.1%

avg_recency_days
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	1155
Distinct (%)	41.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	78.7199783

Minimum	1
Maximum	366
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	21.8 KiB

Quantile statistics

Minimum	1
5-th percentile	13
Q1	34.17361111
median	59
Q3	99
95-th percentile	224
Maximum	366
Range	365
Interquartile range (IQR)	64.82638889

Descriptive statistics

Standard deviation	66.48348631
Coefficient of variation (CV)	0.8445567153
Kurtosis	3.689451832
Mean	78.7199783
Median Absolute Deviation (MAD)	30
Skewness	1.831366256
Sum	218447.9398
Variance	4420.053952
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
70	21	0.8%
46	18	0.6%
55	17	0.6%
31	16	0.6%
49	16	0.6%
91	16	0.6%
42	15	0.5%
21	15	0.5%
35	15	0.5%
26	14	0.5%
Other values (1145)	2612	94.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	9	0.3%
2	4	0.1%
2.861538462	1	< 0.1%
3	6	0.2%
3.330357143	1	< 0.1%
3.351351351	1	< 0.1%
4	5	0.2%
4.191011236	1	< 0.1%
4.275862069	1	< 0.1%
4.5	1	< 0.1%

Value	Count	Frequency (%)
366	1	< 0.1%
365	1	< 0.1%
364	1	< 0.1%
363	1	< 0.1%
357	2	0.1%
356	1	< 0.1%
355	2	0.1%
352	1	< 0.1%
351	2	0.1%
350	3	0.1%

freq_purchase
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
SKEWED

Distinct	1225
Distinct (%)	44.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	0.04970841542

Minimum	0.005449591281
Maximum	17
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	21.8 KiB

Quantile statistics

Minimum	0.005449591281
5-th percentile	0.008746355685
Q1	0.01576875259
median	0.0243902439
Q3	0.04166666667
95-th percentile	0.1153846154
Maximum	17
Range	16.99455041
Interquartile range (IQR)	0.02589791408

Descriptive statistics

Standard deviation	0.3375327534
Coefficient of variation (CV)	6.790253734
Kurtosis	2297.378423
Mean	0.04970841542
Median Absolute Deviation (MAD)	0.0106974754
Skewness	46.09420632
Sum	137.9408528
Variance	0.1139283596
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0.0625	18	0.6%
0.02777777778	17	0.6%
0.02380952381	16	0.6%
0.08333333333	15	0.5%
0.09090909091	15	0.5%
0.03448275862	15	0.5%
0.02941176471	14	0.5%
0.01923076923	13	0.5%
0.02127659574	13	0.5%
0.03571428571	13	0.5%
Other values (1215)	2626	94.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.005449591281	1	< 0.1%
0.005464480874	1	< 0.1%
0.005479452055	1	< 0.1%
0.005494505495	1	< 0.1%
0.005586592179	2	0.1%
0.005602240896	1	< 0.1%
0.005617977528	2	0.1%
0.00566572238	1	< 0.1%
0.005681818182	2	0.1%
0.005698005698	3	0.1%

Value	Count	Frequency (%)
17	1	< 0.1%
3	1	< 0.1%
2	1	< 0.1%
1.142857143	1	< 0.1%
1	8	0.3%
0.75	1	< 0.1%
0.6666666667	3	0.1%
0.550802139	1	< 0.1%
0.5335120643	1	< 0.1%
0.5	3	0.1%

qtd_returned
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
ZEROS

Distinct	202
Distinct (%)	7.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	30.85333333

Minimum	0
Maximum	6504
Zeros	1484
Zeros (%)	53.5%
Negative	0
Negative (%)	0.0%
Memory size	21.8 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	9
95-th percentile	94.3
Maximum	6504
Range	6504
Interquartile range (IQR)	9

Descriptive statistics

Standard deviation	217.5477318
Coefficient of variation (CV)	7.051028472
Kurtosis	413.3825127
Mean	30.85333333
Median Absolute Deviation (MAD)	0
Skewness	17.99659879
Sum	85618
Variance	47327.01561
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	1484	53.5%
1	129	4.6%
2	118	4.3%
3	82	3.0%
4	72	2.6%
6	63	2.3%
5	55	2.0%
12	45	1.6%
8	39	1.4%
9	38	1.4%
Other values (192)	650	23.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	1484	53.5%
1	129	4.6%
2	118	4.3%
3	82	3.0%
4	72	2.6%
5	55	2.0%
6	63	2.3%
7	38	1.4%
8	39	1.4%
9	38	1.4%

Value	Count	Frequency (%)
6504	1	< 0.1%
4427	1	< 0.1%
3768	1	< 0.1%
3332	1	< 0.1%
2878	1	< 0.1%
2022	1	< 0.1%
2012	1	< 0.1%
1776	1	< 0.1%
1594	1	< 0.1%
1535	2	0.1%

freq_returns
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
ZEROS

Distinct	423
Distinct (%)	15.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	0.2598677325

Minimum	0
Maximum	4
Zeros	1484
Zeros (%)	53.5%
Negative	0
Negative (%)	0.0%
Memory size	21.8 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	0.2857142857
95-th percentile	1
Maximum	4
Range	4
Interquartile range (IQR)	0.2857142857

Descriptive statistics

Standard deviation	0.4442600774
Coefficient of variation (CV)	1.709562296
Kurtosis	2.110364105
Mean	0.2598677325
Median Absolute Deviation (MAD)	0
Skewness	1.487162012
Sum	721.1329576
Variance	0.1973670164
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	1484	53.5%
1	663	23.9%
2	10	0.4%
0.5	7	0.3%
0.2857142857	7	0.3%
0.02564102564	7	0.3%
0.25	6	0.2%
0.009478672986	5	0.2%
0.01960784314	5	0.2%
0.01298701299	5	0.2%
Other values (413)	576	20.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	1484	53.5%
0.005571030641	1	< 0.1%
0.005681818182	1	< 0.1%
0.005865102639	1	< 0.1%
0.005934718101	1	< 0.1%
0.005952380952	1	< 0.1%
0.006024096386	1	< 0.1%
0.006042296073	1	< 0.1%
0.006172839506	1	< 0.1%
0.006191950464	1	< 0.1%

Value	Count	Frequency (%)
4	1	< 0.1%
3	1	< 0.1%
2	10	0.4%
1	663	23.9%
0.75	1	< 0.1%
0.6666666667	3	0.1%
0.5	7	0.3%
0.4285714286	1	< 0.1%
0.4	4	0.1%
0.3333333333	1	< 0.1%

avg_basket_size
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	1937
Distinct (%)	69.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	229.337363

Minimum	1
Maximum	3868.65
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	21.8 KiB

Quantile statistics

Minimum	1
5-th percentile	45
Q1	103.3333333
median	172
Q3	278.147619
95-th percentile	583.45
Maximum	3868.65
Range	3867.65
Interquartile range (IQR)	174.8142857

Descriptive statistics

Standard deviation	237.5446348
Coefficient of variation (CV)	1.035786894
Kurtosis	45.2482469
Mean	229.337363
Median Absolute Deviation (MAD)	81
Skewness	5.148880489
Sum	636411.1823
Variance	56427.45354
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
100	11	0.4%
86	9	0.3%
60	8	0.3%
75	8	0.3%
197	7	0.3%
105	7	0.3%
208	7	0.3%
136	7	0.3%
82	7	0.3%
73	7	0.3%
Other values (1927)	2697	97.2%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	1	< 0.1%
3.333333333	1	< 0.1%
5.333333333	1	< 0.1%
5.666666667	1	< 0.1%
6.142857143	1	< 0.1%
7.5	1	< 0.1%
9	1	< 0.1%
9.5	1	< 0.1%
11	1	< 0.1%
11.875	1	< 0.1%

Value	Count	Frequency (%)
3868.65	1	< 0.1%
2880	1	< 0.1%
2733.944444	1	< 0.1%
2518.769231	1	< 0.1%
2160.333333	1	< 0.1%
2082.225806	1	< 0.1%
2000	1	< 0.1%
1903.5	1	< 0.1%
1866.933333	1	< 0.1%
1858	1	< 0.1%

avg_basket_variety
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION

Distinct	897
Distinct (%)	32.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	17.14934231

Minimum	0.2
Maximum	177
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	21.8 KiB

Quantile statistics

Minimum	0.2
5-th percentile	2
Q1	7.558441558
median	13.5
Q3	22
95-th percentile	45.075
Maximum	177
Range	176.8
Interquartile range (IQR)	14.44155844

Descriptive statistics

Standard deviation	14.25626243
Coefficient of variation (CV)	0.8313008263
Kurtosis	10.0170937
Mean	17.14934231
Median Absolute Deviation (MAD)	6.666666667
Skewness	2.246725171
Sum	47589.4249
Variance	203.2410185
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
8	34	1.2%
13	33	1.2%
9	32	1.2%
16	32	1.2%
7	32	1.2%
12	30	1.1%
14	29	1.0%
6	29	1.0%
17	29	1.0%
18.5	29	1.0%
Other values (887)	2466	88.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.2	1	< 0.1%
0.25	3	0.1%
0.3333333333	6	0.2%
0.4	1	< 0.1%
0.4090909091	1	< 0.1%
0.5	12	0.4%
0.5454545455	1	< 0.1%
0.5555555556	1	< 0.1%
0.5714285714	1	< 0.1%
0.6176470588	1	< 0.1%

Value	Count	Frequency (%)
177	1	< 0.1%
105	1	< 0.1%
104	1	< 0.1%
98	1	< 0.1%
95.5	1	< 0.1%
94.33333333	1	< 0.1%
93.33333333	1	< 0.1%
89.625	1	< 0.1%
87	1	< 0.1%
85.66666667	1	< 0.1%

item_rp_ratio
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
ZEROS

Distinct	1238
Distinct (%)	44.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	0.01593666388

Minimum	0
Maximum	1
Zeros	1484
Zeros (%)	53.5%
Negative	0
Negative (%)	0.0%
Memory size	21.8 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	0.008385781091
95-th percentile	0.07096568749
Maximum	1
Range	1
Interquartile range (IQR)	0.008385781091

Descriptive statistics

Standard deviation	0.05860718928
Coefficient of variation (CV)	3.677506769
Kurtosis	71.20361791
Mean	0.01593666388
Median Absolute Deviation (MAD)	0
Skewness	7.452081763
Sum	44.22424226
Variance	0.003434802636
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	1484	53.5%
0.01360544218	3	0.1%
0.002463054187	3	0.1%
0.002309468822	3	0.1%
0.007462686567	3	0.1%
0.0243902439	3	0.1%
0.01229508197	3	0.1%
0.01492537313	3	0.1%
0.009661835749	3	0.1%
0.003773584906	2	0.1%
Other values (1228)	1265	45.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	1484	53.5%
0.0001169636243	1	< 0.1%
0.0001839926403	1	< 0.1%
0.0002816901408	1	< 0.1%
0.0003140703518	1	< 0.1%
0.0003619254434	1	< 0.1%
0.0003632401017	1	< 0.1%
0.0003637686431	1	< 0.1%
0.0003671071953	1	< 0.1%
0.000393081761	1	< 0.1%

Value	Count	Frequency (%)
1	1	< 0.1%
0.6333333333	1	< 0.1%
0.6008836524	1	< 0.1%
0.5964566929	1	< 0.1%
0.5648854962	1	< 0.1%
0.5646387833	1	< 0.1%
0.5602040816	1	< 0.1%
0.5399061033	1	< 0.1%
0.5332103321	1	< 0.1%
0.5208333333	1	< 0.1%

net_margin
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	1295
Distinct (%)	46.7%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	0.979610587

Minimum	0
Maximum	1
Zeros	1
Zeros (%)	< 0.1%
Negative	0
Negative (%)	0.0%
Memory size	21.8 KiB

Quantile statistics

Minimum	0
5-th percentile	0.9063504779
Q1	0.9846235941
median	1
Q3	1
95-th percentile	1
Maximum	1
Range	1
Interquartile range (IQR)	0.01537640594

Descriptive statistics

Standard deviation	0.06051134253
Coefficient of variation (CV)	0.06177081315
Kurtosis	66.77619311
Mean	0.979610587
Median Absolute Deviation (MAD)	1.110223025 × 10^-16
Skewness	-6.846425452
Sum	2718.419379
Variance	0.003661622575
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	1337	48.2%
1	59	2.1%
1	45	1.6%
1	43	1.5%
0.9809727315	1	< 0.1%
0.9963983289	1	< 0.1%
0.9580622895	1	< 0.1%
0.9996149715	1	< 0.1%
0.5357868287	1	< 0.1%
0.9823279406	1	< 0.1%
Other values (1285)	1285	46.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	1	< 0.1%
0.1401705408	1	< 0.1%
0.2502340912	1	< 0.1%
0.3548601864	1	< 0.1%
0.48	1	< 0.1%
0.4896078852	1	< 0.1%
0.5155265001	1	< 0.1%
0.5202155208	1	< 0.1%
0.5301734908	1	< 0.1%
0.5346581286	1	< 0.1%

Value	Count	Frequency (%)
1	45	1.6%
1	1337	48.2%
1	59	2.1%
1	43	1.5%
0.9999180769	1	< 0.1%
0.9998431613	1	< 0.1%
0.9997243132	1	< 0.1%
0.9996728761	1	< 0.1%
0.9996149715	1	< 0.1%
0.9995424698	1	< 0.1%

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Count
Matrix

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

First rows

	df_index	customer_id	gross_revenue	recency_days	qnt_purchases	var_products	qnt_items	avg_ticket	avg_recency_days	freq_purchase	qtd_returned	freq_returns	avg_basket_size	avg_basket_variety	item_rp_ratio	net_margin
0	0	17850	5391.21	372.0	34.0	21.0	1733.0	18.152222	1.000000	17.000000	40.0	1.000000	50.970588	0.617647	0.023081	0.980973
1	1	13047	3232.59	56.0	9.0	105.0	1390.0	18.904035	52.833333	0.028302	35.0	0.023973	154.444444	11.666667	0.025180	0.955611
2	2	12583	6705.38	2.0	15.0	114.0	5028.0	28.902500	26.500000	0.040323	50.0	0.105263	335.200000	7.600000	0.009944	0.988660
3	3	13748	948.25	95.0	5.0	24.0	439.0	33.866071	92.666667	0.017921	0.0	0.000000	87.800000	4.800000	0.000000	1.000000
4	4	15100	876.00	333.0	3.0	1.0	80.0	292.000000	20.000000	0.073171	22.0	0.078947	26.666667	0.333333	0.275000	0.725000
5	5	15291	4623.30	25.0	14.0	61.0	2102.0	45.326471	26.769231	0.040115	29.0	0.032468	150.142857	4.357143	0.013796	0.984472
6	6	14688	5630.87	7.0	21.0	148.0	3621.0	17.219786	19.263158	0.057221	399.0	0.019608	172.428571	7.047619	0.110191	0.907032
7	7	17809	5411.91	16.0	12.0	46.0	2057.0	88.719836	39.666667	0.033520	41.0	0.013072	171.416667	3.833333	0.019932	0.987609
8	8	15311	60767.90	0.0	91.0	567.0	38194.0	25.543464	4.191011	0.243316	474.0	0.072193	419.714286	6.230769	0.012410	0.977808
9	9	16098	2005.63	87.0	7.0	34.0	613.0	29.934776	47.666667	0.024390	0.0	0.000000	87.571429	4.857143	0.000000	1.000000

Last rows

	df_index	customer_id	gross_revenue	recency_days	qnt_purchases	var_products	qnt_items	avg_ticket	avg_recency_days	freq_purchase	qtd_returned	freq_returns	avg_basket_size	avg_basket_variety	item_rp_ratio	net_margin
2765	5612	17290	525.24	3.0	2.0	92.0	404.0	5.149412	13.0	0.142857	0.0	0.0	202.000000	46.000000	0.000000	1.000000
2766	5621	14785	77.40	10.0	2.0	2.0	84.0	25.800000	5.0	0.333333	0.0	0.0	42.000000	1.000000	0.000000	1.000000
2767	5622	17254	272.44	4.0	2.0	100.0	252.0	2.432500	11.0	0.166667	0.0	0.0	126.000000	50.000000	0.000000	1.000000
2768	5639	17232	421.52	2.0	2.0	30.0	203.0	11.708889	12.0	0.153846	0.0	0.0	101.500000	15.000000	0.000000	1.000000
2769	5640	17468	137.00	10.0	2.0	5.0	116.0	27.400000	4.0	0.400000	0.0	0.0	58.000000	2.500000	0.000000	1.000000
2770	5651	13596	697.04	5.0	2.0	133.0	406.0	4.199036	7.0	0.250000	0.0	0.0	203.000000	66.500000	0.000000	1.000000
2771	5657	14893	1237.85	9.0	2.0	72.0	799.0	16.956849	2.0	0.666667	0.0	0.0	399.500000	36.000000	0.000000	1.000000
2772	5682	14126	706.13	7.0	3.0	14.0	508.0	47.075333	3.0	0.750000	50.0	1.0	169.333333	4.666667	0.098425	0.911489
2773	5688	13521	1092.39	1.0	3.0	312.0	733.0	2.511241	4.5	0.300000	0.0	0.0	244.333333	104.000000	0.000000	1.000000
2774	5698	15060	301.84	8.0	4.0	80.0	262.0	2.515333	1.0	2.000000	0.0	0.0	65.500000	20.000000	0.000000	1.000000

Overview

Variables

Interactions

Correlations

Spearman's ρ

Pearson's r

Kendall's τ

Phik (φk)

Missing values

Sample

First rows

Last rows